Weak and strong typicality in quantum systems 
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We study the properties of mixed states obtained from eigenstates of many-body lattice Hamiltonians after 
tracing out part of the lattice. Two scenarios emerge for generic systems: (i) the diagonal entropy becomes 
equivalent to the thermodynamic entropy when a few sites are traced out (weak typicality); and (ii) the von 
Neumann (entanglement) entropy becomes equivalent to the thermodynamic entropy when a large fraction of 
the lattice is traced out (strong typicality). Remarkably, the results for few-body observables obtained with the 
reduced, diagonal, and canonical density matrices are very similar to each other, no matter which fraction of the 
lattice is traced out. Hence, for all physical quantities studied here, the results in the diagonal ensemble match 
the thermal predictions. 
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Despite advances, the emergence of thermodynamics from 
quantum mechanics is still a subject under debate. How to 
derive, from first principles, proper ensembles leading to the 
basic thermodynamic relations is not yet entirely clear. Ac- 
cording to the concept of canonical typicality [1], the reduced 
density matrix of a subsystem of most pure states of many- 
particle systems is canonical. The proof of this statement re- 
quires a partition of the original system into a small "system" 
and a large "environment". However, for example, suppose 
that our universe is in a pure state and that we trace out only a 
finite number of degrees of freedom. Can we describe the rest 
of the universe using statistical mechanics? How much one 
needs to trace out, how well the notion of canonical typicality 
works in finite systems, and which quantities will be more or 
less affected by the fraction of the original system traced out 
are questions that have received little attention. They are the 
more pressing giyen the progress made in experiments with 
ultracold gases |2l]. 

We can discuss these issues in the context of entropy. If one 
takes an eigenstate of a generic many-body Hamiltonian and 
traces out the "environment" {£), the grand canonical (GC) 
ensemble is the appropriate ensemble to describe the system 
{S) that is left, where the total energy and number of particles 
fluctuate. One immediately realizes that the GC-entropy, 5gc, 
must be different from the von Neumann entropy, 5vn, if only 
a small fraction of the original system is traced out. In this 
case, S'vN is extensive in the size of the environment, instead 
of in the size of the system as ^gc- This follows from the fact 
that, for a composite system S + £■ in a pure state /5 = j^*) (^Pl, 
the reduced von Neumann entropy is defined as 



5vN = -Tis [ps lnp5] = -Trg [pg hipe] , 



(1) 



where the Boltzmann constant is set to unity and the reduced 
density matrix ps = Tr^p and similarly p£ ~ Tr^p. 5vn 
has been widely used to measure the entanglement in bipartite 
systems jsl. If the pure state is separable, p = ps ® Ps, then 
S'vN = 0, while maximum entanglement leads to S'vN = In T^, 
where T) is the smallest dimension of the two subsystems. The 
source of the disparity between Svn and Sec is the informa- 



tion present in the off-diagonal elements of the reduced den- 
sity matrix, which is not contained in the thermodynamic en- 
semble. When a large fraction of the original system is traced 
out, the equivalence between Svn and Sec is expected (canon- 
ical typicality). However, up to our knowledge, it has not been 
demonstrated for realistic systems. 

Now suppose that instead of tracing out the environment, 
we physically cut it off and let the remaining system relax to 
equilibrium. We can then ask how much one needs to cut for 
the entropy of the reduced system to become equivalent to Sec 
(if ever). After relaxation, this system is described by the diag- 
onal ensemble 10, Etl obtained by writing the reduced density 
matrix {ps) in the energy eigenbasis. The proper thermody- 
namic entropy in this case has been argued to be the diagonal 
entropy laLZl], defined as 



Sd = - ^ Pnn ln(p„„), 



(2) 



where p„„ are the diagonal elements of the density matrix. 
Sd counts logarithmically the number of energy eigenstates 
which are occupied in S. Unlike Svn, Sd is extensive in the 
system size even if we trace a very small environment, e.g., 
a single degree of freedom. Cutting off the environment is 
equivalent to a sudden quench; it introduces to the system the 
(nonextensive) energy uncertainty SEq- This uncertainty im- 
plies that if all the eigenstates of the subsystem Hamiltonian 
Hs within the window ±5Es are occupied with roughly the 
same weights, then Sd ~ \ogVL{Es)5Es, where Vl{Es) is 
the density of states in S. Up to subextensive corrections, Sd 
would then coincide with the thermodynamic entropy of S. 

In this Letter, we study the properties of mixed states ob- 
tained from eigenstates of a many-body lattice Hamiltonian 
after tracing out or cutting off an increasingly large environ- 
ment. One of our goals is to understand the structure of the 
remaining reduced density matrix and if it ever becomes ther- 
mal, which we monitor using Svn, Sec, and Sd. We find that, 
for nonintegrable systems, Sd approaches Sec after cutting 
off a few (possibly one) sites, i.e., our hypothesis above is 
verified. Svn, on the other hand, remains different from Sd 
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and Sgc until a large fraction of the lattice is traced out j^. 
This motivates us to distinguish between the conventional (or 
strong) typicality S'vn ^ Sd = See and a weaker typicality in 
the sense that S'vn Sd = Sqc- The latter implies that only 
the diagonal part of the density matrix of the reduced system 
in the energy eigenbasis exhibits a thermal structure. 

Our results then show that the diagonal entropy satisfies the 
key thermodynamic relation: 



dSs 



dEs dEs 



1 



(3) 



where E^ and Eg are the energies of the subsystems. This fol- 
lows from the fact that 5*^ coincides with the thermodynamic 
entropy for S and £ simultaneously. In contrast, S'vn cannot 
satisfy this equality, as one can see by considering £ ^ S. In 
this case, Svn = Sg = Sg is proportional to the size of S, 
while Eg is proportional to the size of £, so dSg / dEg — > 0. 

Another of our main goals in this work is to understand the 
description of few-body observables in the mixed states ob- 
tained by the two procedures mentioned before. For that, we 
study their expectation values as given by the reduced density 
matrix, the diagonal ensemble, and the GC ensemble. The 
results for the first two are similar even if very few sites are 
traced out and the system sizes are small. This suggests that 
either tracing out part of the original system or removing the 
same number of sites and waiting for the reduced system to 
relax leads to the same results, up to non-extensive bound- 
ary terms. For all practical purposes both procedures are then 
equivalent. The agreement with the GC expectation values is 
also good and improves with increasing system size. This im- 
plies that, for few-body observables, only weak typicality is 
needed to observe thermal behavior in experiments. 

System.- We study hard-core bosons in a one-dimensional 
lattice with open-boundary conditions described by 



L-l 



(4) 



+ J2 -t(^b^+l+ii■c■ 

1=1 



-t' (blb,+2 + H.c, 



where, t and t' [V and V'] are nearest-neighbor (NN) and 
next-nearest-neighbor (NNN) hopping [interaction], L is the 
chain size, and standard notation has been used |0]. Symme- 
tries, and therefore degeneracies, are avoided by considering 
1/3-filling and by placing an impurity (e 7^ 0) on the first site. 
In what follows, t ~ V ~ I sets the energy scale, e = 1/5 , 
and t' = v. When t' ^ V = 0, the model is integrable iflOl . 
As the ratio between NNN and NN couplings increases, the 
system transitions to the chaotic domain 191]. 

For our calculations, we select an eigenstate | '^j ) of H 
with energy Ej closest to E = Eje~^'/^ - e'^^l^ 
corresponding to an effective temperature T. We then trace 
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FIG. 1: (Color online) (a),(b) Entropies per site vs temperature for 
R = L/3. (c),(d) Entropies per site vs R for a fixed temperature; 
T = 4. (a),(c) t' = V = (integrable); (b),(d) i! = V ^ 0.32 
(chaotic). All panels; L = 18. 



out a certain number of sites R < 2i/3, on the right side 
of the chain, and study the entropies and observables of the 
reduced system. The reduced density matrix pg describing the 
remaining system consists of different subspaces each with a 
number N € [max(L/3 — R,0), L/3] of particles. 

Entropies.- The von Neumann, diagonal, and GC entropies 
are given by Eq. ([T]), Eq. (|2]i, and 



Sgc = In S 



Es - i^Ns 
Tgc 



(5) 



respectively. In Eq. (|5]), S = p(pNr,-E„)/TGc (jjg grand 
partition function, Tgc is the GC temperature, fi is the chem- 
ical potential, and Eg = Ti[Hsps] and = Tt[Nsps] are, 
respectively, the average energy and number of particles in the 
remaining subsystem S. 

Results.- In Fig.lT] we show results for Svn, Sd, and Sgc in 
the integrable [(a),(c)] and chaotic [(b), (d)] domains. Larger 
fluctuations are seen in Figs.[TJa) and[TJc) as characteristic of 
the integrable regime. Figs.[TJa) and[TJb) show the entropies 
vs different eigenstates, which are increasingly away from the 
ground state (T increases), when 1/3 of the sites are traced 
out. In the chaotic regime, and for all states selected, one can 
see that Sd is close to Sgc, while Svn is quite far. This is 
remarkable as it hints a thermal structure in the diagonal part 
of the reduced density matrix in the energy eigenbasis. 

In Figs.[TJc) andlHd) we show results for a fixed T as an in- 
creasingly larger fraction of the original system is traced out. 
One can see again that in the chaotic limit Sd is much closer 
to Sgc than to Svn, even when very few sites are traced out. 
However, in both regimes, all entropies approach each other as 
the fraction of sites traced out increases. For the lattice sizes 
considered here, we need to trace out more than one half of the 
chain for the effects of the off-diagonal elements of the den- 
sity matrix to become irrelevant in Svn, leading this entropy 
to finally approach Sd and Sgc ■ 

The results presented in Fig. [T] were obtained for L — 18, 
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FIG. 2: (Color online) (a)-(d) Entropies per site vs l/L for T = 4 
and a fixed ratio R/L (indicated). (e),(f) Sac — Sd per site vs 1/L 
for i? = 1, 2, and 3. (a),(c),(e) t' = V = (integrable); (b),(d),(f) 
t' = V' = 0.32 (chaotic). 



the largest system size that we can study with full exact di- 
agonalization. Figure |2] depicts the scaling of the entropies in 
both domains, integrable [(a),(c)] and nonintegrable [(b), (d)], 
and for T = 4. In Figs. |2ja) and[2jb), when L/3 sites are 
cut off, Sd and Sac approach each other as L increases, up to 
a possible non-extensive correction. This trend is seen for all 
systems we have studied in the chaotic regime llBll . and opens 
up a new question: could cutting off an infinitesimal part of 
the original system lead 5*^ and Sac to be equal in the thermo- 
dynamic limit? In Figs.|2e) and 13 f), we show the difference 
between Sec and Sd per site vs system size when tracing out 
one, two, or three sites. In the chaotic regime [Fig.|2f)], the 
results are consistent with a vanishing difference in the ther- 
modynamic limit (even when cutting one site ifisll ). Hence, 
one could argue that single eigenstates of many-body Hamil- 
tonians have a thermodynamic entropy 180. Close to the inte- 
grable point [Figs.|2a),|2c), and|2je)], large fluctuations are 
observed for different values of T and t\ V', which makes it 
difficult to draw general conclusions. 

In Figs.|2ta) and|2jb), one can also see that for R = L/3, 
the von Neumann entropy (per site) saturates to a different 
value from Sd and Sqc (per site), as the lattice size increases. 
As shown in Figs. [2c) and|2d), it is only when R > L/2 that 
the three entropies become comparable. However, for our sys- 
tem sizes, this happens only in the chaotic regime. As one ap- 
proaches the integrable point, we again find large fluctuations 
and the results depend on T and the values of t' ,V'. Fluc- 
tuations in the integrable regime are understandable. In the 
chaotic regime (and away from the edges of the spectrum) all 
eigenstates of the Hamiltonian that are close in energy have (i) 
a similar structure, as reflected by the inverse participation ra- 
tio and information entropy in different bases 191], and (ii) ther- 
mal expectation values of few -body observables |0> El E 1 15 1 ■ 
However, this is not the case close to integrability where most 
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FIG. 3: (Color online) (a),(b) Kinetic energy per site and (c),(d) 
n{k = 0) \s R; L = 18; T = 4. (a),(c) t' = V = (integrable); 
(b),(d) t' ^ 0.32 (chaotic). 



quantities fluctuate wildly between eigenstates close in energy 
14 pllgl llSn . and this is affecting our results here. 

Observables.- An important question we are left to address 
is whether the extra information carried by the off-diagonal el- 
ements of the reduced density matrix is of relevance to quan- 
tities measured experimentally. We focus our analysis on few- 
body observables. Their expectation values from the reduced, 
diagonal, and grand canonical density matrices are given by 



OvN = Tr[6/55], = ^ PnnOn,i, 

n 

Occ ~ ;=: ^ On,: 



(6) 



(7) 



respectively. Here, 0„„ = {ipn\0\ipn) and IV'rJ's are the 
eigenstates of the Hamiltonian in the reduced system. 
Results.- Figure [3] shows results for the kinetic energy 



L-R-2 



i=l 



i=l 

(8) 



and the momentum distribution function, 



m = 



L 



(9) 



for an increasingly large fraction of sites traced out. The re- 
sults obtained with the three density matrices are comparable, 
independently of the regime, the number of sites traced out, 
and T (see |13|] ). In particular, the fact that (9vn and Od are 
so close demonstrates that both procedures, tracing sites out 
or cutting off part of the original system and then measuring 
the observables after relaxation, lead to similar outcome. The 
information contained in the off-diagonal elements of the re- 
duced density matrix, which generates discrepancies between 
S'vN and Sd = Sqg^ is therefore irrelevant to few-body ob- 
servables. Our findings also open the interesting question: 
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FIG. 4: (Color online) (a)-(d) Observables vs 1/L for R = L/3. 
(e),(f) Ratio between the grand-canonical temperature and the tem- 
perature vs 1/L. (Black) Plus: t' = V' = 0.04; (red) cross: 
t' = V = 0.08; (blue) star: t' = V = 0.16; (green) diamond: 
t' = V' = 0.32; (purple) down-triangle: t' = V = 0.64. In all 
panels: T = 4. 



which experimentally measurable quantities (if any) could 
distinguish between tracing sites out or cutting them off? 

We note that, in the chaotic regime, the GC results for both 
observables depart from those obtained with the reduced and 
diagonal density matrices as R increases. This is understand- 
able because the GC results are obtained for a system with 
L — R sites and open boundary conditions, while the other 
two are obtained for a system with L sites from which R sites 
are either traced out or cut off. Hence, the more sites one cuts 
off (the larger the value of R), the smaller is the system re- 
maining. Finite size effects are then expected to be stronger, 
in particular as the values of t', V' increase. It is also expected 
that they should vanish in the thermodynamic limit. 

In Figs.|4la)-Htd), we show the scaling behavior of the two 
observables from Fig.[3]for R = L/3. It is apparent that, in the 
chaotic regime [Figs. |4|b) and|4jd)], the observables calcu- 
lated in the three ensembles approach each other with increas- 
ing system size. (Results for other temperatures and observ- 
ables in the chaotic domain are presented in Ref. jl'M ). In the 
integrable limit [Figs. Ua) and|4|c)], large fluctuations pre- 
vent us from reaching general conclusions. This is a regime 
that needs to be studied by other means, which may allow one 
to do a proper extrapolation to the thermodynamic limit. 

A final remarkable property of the mixed states studied here 
is that their effective thermodynamic temperature (Tec) is the 
same as the effective temperature T of the many-body eigen- 
state from which they are obtained. This is shown in Figs.|4{e) 
andgtf), where we plot Tcc/T ws 1/ Lfoi R = L/3 He)] and 
R = 2L/3 Hf)], and for different values of t', V. The two 
temperatures are close (except for the smallest systems sizes) 
and further approach each other as 1/L decreases, which is 
consistent with the idea of eigenstate thermalization where a 
single eigenstate exhibits thermal behavior [l4ll . 



Conclusions.- We have found that, away from integrability, 
the diagonal and grand canonical entropies are very close to 
each other, even when a small portion (probably an infinites- 
imal fraction) of the lattice is cut off. They further approach 
each other with increasing system size. In contrast to Sd, S'vn 
only approaches 5gc when a large part of the original system 
is traced out. This behavior reflects the non-diagonal struc- 
ture of the reduced density matrix when only small fractions 
of the lattice are traced out. Led by these results, we identified 
two different regimes: weak typicality, where the diagonal en- 
semble develops a thermal structure, and strong (canonical) 
typicality, where the density matrix of the reduced system is 
thermal. Close to and at integrability further studies are nec- 
essary. Our results exhibit large fluctuations depending on the 
state selected and the values of t' ,V' . 

We also studied experimentally measurable few-body ob- 
servables as determined from the reduced, diagonal, and 
grand-canonical density matrices. We find that they all lead to 
the same results as the system size increases, no matter how 
many sites are traced out. This demonstrates that the extra 
information contained in the off-diagonal elements of the re- 
duced density matrix is irrelevant to those observables. There- 
fore, it is plausible to conjecture that the expectation values of 
physical observables in subsystems of any size obtained from 
generic many-body eigenstates can be entirely obtained from 
standard statistical ensembles. Our results show that even 
in relatively small systems, both procedures, tracing out the 
"bath" or cutting it off and letting the subsystem thermalize, 
lead to the same outcome. 
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NSF under grant DMR-0907039, the AFOSR under grant 
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Note added. — After completion of this work, we have 
learned that the strong (canonical) typicality has been recently 
verified in translationally invariant systems lfl6ll . 
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ENTROPIES 

Figure |5] provides further support to our statement that Sd 
approaches Sec as the system size increases. This fact holds 
even for the smallest value i? = 1, suggesting that in the ther- 
modynamic limit, the diagonal density matrix becomes a ther- 
mal density matrix when an infinitesimally small part of the 
system is traced out. 




FIG. 5: (Color online) Sac — Sd per site vs 1/L for the three small- 
est values of R. The values of t' , V' are indicated and they imply 
chaoticity. 



OBSERVABLES 

Figure|6]reinforces that the expectation values of few-body 
observables obtained with the reduced, diagonal, and grand 
canonical density matrices are comparable, independently of 



the regime, the number of sites traced out, and T. In the figure 
we show the behavior of physical observables vs temperature. 
We consider the kinetic energy, the momentum distribution 
function for fc = and k = 1, and the interaction energy: 




The results for Od and OvN are very similar through- 
out. They indicate that the information contained in the off- 
diagonal elements of the reduced density matrix is therefore 
irrelevant to few-body observables. We note that while Ogc 
is also very close to Od and Ovn, the GC results for n{k = 0) 
and / are slightly more separated, since these observables are 
more sensitive to finite size and boundary effects than K. 
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FIG. 6: (Color online) Interaction energy per site, kinetic energy per 
site, and momentum distribution function for fc = and fc = 1 vs 
temperature; L = 18; i? = L/3; t' = V' = 0.32. Triangles; Ogc, 
squares: Od, and circles: OvN- 
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The scaling behavior of the observables considered here are shown in Fig. [T] for R = L/i and values of t', V in the chaotic 
region. In this regime, the observables calculated in the three ensembles approach each other with increasing system size. 
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FIG. 7: (Color online) Interaction energy per site, kinetic energy per site, and momentum distribution function for = and k — 1 vs 1/L; 
T — 5. Triangles: Occ, squares: Od, and circles: Ovn\ R = L/3. The values of t' , V' for each column are indicated at the top panels. 



